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A NOTE ON BIOLOGICAL PERIODICITIES 


N. RASHEVSKY 
THE UNIVERSITY OF CHICAGO 


The approximation method for solving diffusion problems is gen- 
eralized to enable computation not only of the fundamental frequency, 
but also of higher harmonics in certain types of periodic solutions. 


Following a suggestion by the author (Rashevsky, 1938; 1948a, 
chap. vi), Alvin M. Weinberg (1938) showed that diffusion phenom- 
ena in spherical cells may show periodicities when there are two in- 
teracting substances involved. Weinberg considered only solutions 
which possess central symmetry. The more general case was later 
studied by the author (Rashevsky, 1948b). Soon after the publica- 
tion of his paper, A. Weinberg (1939) showed that essentially the 
same results may be obtained in a much more simple manner by the 
use of the approximation method (Rashevsky, 1940). This method, 
however, yields only the fundamental frequency of oscillations, where- 
as actually there is a discrete infinite number of possible frequencies. 
The purpose of this note is to show how the approximation method 
can be extended to give all possible frequencies. 

The reason for the apparent failure of the approximation method 
to give all the frequencies can be readily seen. To each higher fre- 
quency there corresponds a distribution of concentration in the cell 
which fluctuates in space and has several maxima and minima. The 
approximation method, as used hitherto, presupposes essentially a 
menotonic, or almost monotonic, variation of concentration between 
the center and the periphery of the cell. It presupposes the same di- 
rection of flow of the metabolite at all points of any line joining the 
center to the periphery. If, however, there are maxima and minima 
of the concentrations in the cell, then the metabolite flows out of re- 
gions of high concentration into regions of low concentration. There 
are internal flows which are not all directed in the same way. Cases 
of purely internal flows, without exchange with the surrounding me- 
dium, have, however, been studied (Rashevsky, 1948a, chap. xix) in 
connection with polarity of spheroidal cells, by dividing the cell into 
two regions, and expressing the interchange of metabolites between 
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the two regions. This procedure may be generalized for the present 
case. 

There is a discrete infinite number of periodical solutions (Ra- 
shevsky, 1948b), each characterized by an eigenvalue of the boundary 
problem and by a corresponding frequency. Each solution represents, 
in general, a highly complex distribution of concentrations which is 
highly asymmetric even for a spherical cell. Through proper combina- 
tion of these solutions we can obtain practically any configuration of 
any complexity. To such a general configuration there will, however, 
correspond not one, but a large number of frequencies. 

To apply the approximation method, we proceed as follows: 

Subdivide the cell, which now does not need to be spherical, into 
N regions of arbitrary size and shape. The only limitation is that 
these regions fill the space of the cell densely. We again consider two 
substances. We denote the average concentration of the first substance 
in the ith region by c,“; that of the second by c.“. We again as- 
sume that the rate of production of the first substance is given any- 
where by 

Q1 = Ay 0, 1+ Apolo , (1) 


and that of the second by 
Qo = Mq161 1 AnoCo , : (2) 


where 4; , Qi. , Go, , ANG Go are constants. 

The inside diffusion coefficients are the same everywhere, and 
we denote them by D;, and Dj.. We denote the outside diffusion co- 
efficients by D., and D... The outside concentrations are denoted by 
Coz, ANG-Coe s 

A region R; may be adjacent either only to other regions R;, R,, 
Rn; or partly to other regions, partly to the membrane of the cell. 
The permeabilities of the latter for the two substances shall be de- 
noted by h, and h,. 

We now may write down the expression for the material balance 
of each region in exactly the same way as we do for a single cell 
(Rashevsky, 1940, 1948a). The only difference is that now, instead 
of a flow only in two directions, longitudinal and transverse, we shall 
have as many flows as the given region has adjacent regions. Thus 
for the first substance we shall find an expression of the form 


de,“ 
dt 


aS a,c, ae OC) ze SS dix (ce, a c,)) 
k 


(3) 


i Ae, = Con ; 
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where ix are constants determined by the sizes and shapes of the ith 
region and of all the adjacent regions R;, and the summation is ex- 
tended over all the adjacent regions. The J;;’s also contain D;, .The 
quantities 2; appear only for such regions as are adjacent to the mem- 
brane of the cell and contain, beside the size and shape of the region, 
the quantity h, and D.,. A similar equation holds for c, . 


If we write all the differential equations for all N regions, and 
if we put 


CO =%,; C%=—1; ¢, =433 c= 4,---: etc., (4) 


we obtain a system of M = 2N linear differential equations of the 
form 


= DAs, (5) 


in which, in general, a number of A,,’s are equal to zero. All the 
A,,’s depend on the sizes and shapes of the different regions. Those 
sizes and shapes are determined in the usual way by the three overall 
dimensions 7,, 7,, and r,“. For each region we have, in general, 
the problem of the “triaxial cell” (Householder, 1942). 

The secular equation 


Ai ew? ALS SM O88) het eine Ay 
ws; As ret Ee at Tears Aoy 
==) (6) 
| Am Aye Aum rig 


will have, in general, M roots, some real, some complex. This means 
that the particular configuration is a composite one consisting of the 
superposition of several configurations with different eigenvalues. 
If equation (6) has only a pair of conjugate complex roots; or, which 
is infinitely improbable (Rashevsky, 1948b), two purely imaginary 
roots, that means that configuration is a “simple” one, corresponding 
to an eigenvalue in the exact treatment of the problem. 

The important problem now is to determine such configurations 
for which equation (6) has only one pair of conjugate complex roots. 
For small values of N, and for simple arrangements, this is not too 
difficult. In general, however, the problem is not easy. For a fixed 
M, the coefficients A,, are functions of the 3M quantities r.“, 7, 
and r,. The requirement that equation (6) has only a pair of con- 
jugate complex roots leads to some relations between the coefficients 
A,;, and thus to relations between the quantities 7, 72, and r;". 


204 BIOLOGICAL PERIODICITIES 


Although we reduce the problem to a system of algebraic equations, 
because of the large number of variables it becomes rather unwieldy. 
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A NOTE ON THE PROBABILISTIC APPROACH TO 
THE CANCER PROBLEM 


N. RASHEVSKY 
THE UNIVERSITY OF CHICAGO 


Assuming that the initiation of cancer growth is due to a purely 
accidental fluctuation of some physicochemical condition, it is possible 
to derive the equation for the cancer incidence as a function of age. The 
final result depends on whether it is assumed that a single accidental 
fluctuation in a cell is sufficient to produce cancer, or that a finite num- 
ber, k, of repetitions of the accidental fluctuation must occur in the same 
cell. In principle it is possible to determine from observed incidence 
curves the number k. Actually, however, this cannot be done at present, 
because the difference of the theoretical curves for different k’s is rather 
small, and the available cancer statistics are not accurate enough to 
show such differences. 


In a previous paper (Rashevsky, 1945) we suggested the cir- 
cumstance that every individual case of spontaneous cancer incidence 
seems to be determined by chance as a possible starting point for a 
mathematical theory of cancer. While we can predict with greater 
or lesser accuracy the incidence of cancer as a function of age or other 
variables in a large population, nothing can be predicted about each 
individual case. With this probabilistic concept as a starting point, 
and with the aid of an additional assumption about the interaction 
of two factors, a growth promoting one and a growth inhibiting one, 
we derived the equation for the variation of cancer incidence with age. 
This equation proved to be in good agreement with available data. 

Whatever the physicochemical changes may be which result in 
a transformation of a normal cell into a cancer cell, it seems likely 
that these changes are of the nature of an accidental fluctuation. The 
purpose of this note is to show that regardless of the physicochemical 
mechanism involved, the notion of accidental fluctuation leads to some 
consequences which, in principle, may be tested experimentally, and 
inversely, that some conclusions as to the character of these fluctua- 
tions may be shown from appropriate observation. : 

Let us first consider the unrealistic abstract case of a uniform 
population of identical individuals. Let the probability that any one 
cell of the individual undergoes an accidental fluctuation which trans- 
forms it into a cancer cell at a time between ¢ and ¢ + dé after birth 
be p(t)dt. We shall refer to such a fluctuation as “cancer fluctua- 
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tion.” What is the probability that the individual will develop cancer 
for the first time at the age t? 

Divide the time into equal small intervals At, numbered succes- 
sively beginning from the time of birth. Let », be the probability 
of a cancer fiuctuation during the kth interval. The probability of the 
cancer fluctuation not occurring during the kth interval is 1 — p,. 
The probability that a cancer fluctuation does not occur during the 
first i — 1 intervals, and occurs during the ith interval for the first 
time, is 


P,,= (1— D1) 92) (T= piay)D; - (1) 
Consider the product 
Ki. = (1—p,) (1— 9) :--- 1 — dia). (2) 
If, as is usually the case, », << 1, we have 
i-1 4-1 
log Ki. =X log (1—%) =—- UM, (3) 
or | + i ae aE 
v mast 
Kia=exp| —Sp. | ; (4) 
1 


Introducing this into (1) we find 
Pu=piexp| —Em |. (5) 
af 


Now let the intervals tend to zero, their number increasing indef- 
initely. Then 


pi=pi(t)d, (6) 
and the sum in (4) and (5) tends to the integral 
t 
{ p(r)dr. (7) 


Hence, denoting by P,(t)dt the probability of a cancer fluctua- 
tion occurring for the first time between t and t + dt, we have from 


(5) 


+t 
P, (t) dt = p(t) exp \- J p(r)dr | dt. (8) 
0 
In particular if 


p(t) =—p= (constant), (9) 
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we find 
P, (t) dt = pe*tdt , (10) 


Thus for a constant p(t) = p, the incidence of cancer decreases mo- 
notonically with age. 

Actually, for ages above 20 years, the incidence curve increases 
exponentially, and then at about the age of 60 years (Hoffman, 1915), 
the rate of increase declines. What can we conclude from this about 
the function p(t)? Suppose that P,(t) is given empirically. Then, 
shortening equation (8) by dt and taking logarithms, we have: 


t 
log p(t) — { p (1) dr = log P,(t). (11) 
Differentiating (11) and rearranging, we find: 
dp(t) d 
en eee 2 t — t —] 1E t . 12 
ai p*(t) heer (t) (12) 
As observation seems to indicate, let 
P,(t) =Ae*; log P,(t) =log A + at, (13) 


where A and a are constants. 
Introducing (13) into (12) we find: 
dp (t 
PA) ap (t) + p(t). (14) 
dt 
Integrating this with the initial condition for t= 0, p(t) =, we 
find: 


Do ae 


p(t) = (15) 


Dy + a—~p, er 
For at = log (yp, + a)/po, the function p(t) becomes infinite. 

Thus, if relations (13) hold, and if the occurrence of cancer is 
due to a single cancer fluctuation in a cell, the probability of such a 
fluctuation is given by (15). 

We may, however, consider the more general possibility, namely, 
that a normal cell becomes a cancer cell after & accidental fluctuations 
occur in it. The first fluctuation would leave some kind of a trace 
which is enhanced by the subsequent fluctuations. Let us consider 
the simplest case, where the probability of a fluctuation is indepen- 
dent of whether any fluctuations occurred in the cell previously, and is 
equal to a constant p . The probability P; (¢) dt now equals the product 
of the probability p(t, k —1) that k—1, and only k—1, fluctuations 
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have occurred in the cell in the interval 0 to t, and that one fluctua- 
tion occurs between ¢ andt + dt. 

To compute p(t, k — 1) we proceed as follows: Divide again 
the interval 0, ¢ into n equal intervals. The probability of a fluctua- 
tion occurring within any interval is now 


p=pAt. (16) 


The probability of the fluctuation occurring only k — 1 times in the 
n trials is equal to 


n! 
rn(k— = —_____—_—_—_————_ p kK-1 — Dp, n—K+1 
Pa (k= a et (17) 


Again let 1 increase indefinitely, At decreasing to zero. Then the ex- 
pression n!/(k — 1)! (n—k + 1)! tends to 


mk-1 
GD! 5: 
and p,(k — 1) tends to p(t, k —1). The probability p, now becomes 
J— pace (19) 


The factor (1 — p dt)"*" tends with increasing n to (1 — p dt)”, 
or, because of 


t 
ae (20) 
to 
Di\® 
eee Cy 
Put 
pt 1 
i eg fe 


Then (21) becomes 


for) (ee 


As » increases, the absolute value of z increases also, and the 
right-hand side of (23) tends to e-**, 


Expression (20) introduced into (18) gives 


i 1 


(k—D "(dt 24) 
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while p,** becomes, because of (19): 
pr (dt)*4, (25) 
Hence, as n tends to infinity, p, (k — 1) tends to 


1 
p(t; k—1) =——_ - 79k-1 fk-1 e-pt 
(k—1) t Co) 
Therefore, we find for P, (t) dé: 
1 
P, (t) dt = ———_ pp (1 et dt, 
(k—1) i” Sn) 


For k > 2, P,(t) increases first with an increasing first derivative 
then reaches an inflection point, and eventually a maximum. To the 
left of the maximum, the P,(¢) curve has qualitatively a shape simi- 
lar to the observed cancer incidence curves. Its initial increase is, 
however, not exponential. In principle it is easy to discriminate em- 
pirically between an exponential curve, as given by (10), and the left 
end of the curve (27). Thus we could decide between the hypothesis 
of a single fluctuation with variable probability and a multiple fluc- 
tuation with a constant probability. Actually the cancer incidence 
data are hardly accurate enough, and the individual empirical points 
are sufficiently scattered, to make such a decision at present doubt- 
ful. More accurate data are certainly needed. 

It is, of course, possible to generalize the case of & fluctuations 
for a probability which varies with time. 

The empirical value of the above considerations is very much 
reduced by the fact that in reality we do not deal with a uniform 
population. Consider, for instance, the case of a single fluctuation 
with constant probability. Let there be a distribution of p in a popu- 
lation of N, individuals so that the frequency of a » laying between 
p and » + dp is 
N(p)dp. (28) 


If equation (10) holds for a uniform population, then for a case 
of a population characterized by (28), we have 


P,(t) = fi ” Np) pe* dp, (29) 


which is different from (10). Similar considerations apply to other 
cases. In order to make use of the approach suggested here, it is es- 
sential to have a uniform population. This can be done with experi- 
mental animals such as mice. A difficulty, however, arises because of 
an insufficient number of individuals. Several hundred thousand mice 
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have been reared in laboratories for cancer research purposes. They 
are of a number of different genetically homogenous strains. But for 
one particular strain, the number of mice is of the order of a few 
thousands. The number of individuals per age groups is still less, and 
accurate statistics are thus impossible. In humans, we deal with popu- 
lations of millions but with heterogenous material. 

The cancer fluctuation discussed above may be conceived as due 
to the kinetic fluctuations of the number of molecules of some sub- 
stance contained within the cell. If » denotes the average number of 
molecules in an element of volume, then the probability that the rela- 
tive accidental fluctuation of this number will be between 6 and 6 + dd 
is given by 


62 


W(a)do= |e = dé. (30) 
2n 


The molecules in question._may be those of some important catalyst 
which controls essential cell reactions. In order to throw a normal 
cell entirely out of balance, we would expect that 6 should be rather 
large. In humans the probability of cancer incidence is of the order 
of 10° per person. An individual is composed of some 10** cells. 
Hence the probability of a cancer fluctuation in a cell is of the order 
of 10-*. Taking arbitrarily as a value of the relative fluctuation ca- 
pable of producing cancer, one that lies between 0.5 and 0.6, we have 
6 = 0.5; dé = 0.1. Introducing those values into (30) and putting 
W (6) dé = 10° , we find » ~ 300. We obtain the same order of mag- 
nitude for » if we assume arbitrarily that any fluctuation larger than 
0.5 will produce cancer. If we consider the fluctuation as occurring 
in the cell as a whole, and take the average volume of a cell as 10-° 
cm*, the above figure corresponds to a concentration of 5 X 107 mols 
per liter. If the critical fluctuation must occur only in a small part 
of the cell, say, 0.01 of its volume, then the concentration of the sub- 
stance would be 5 X 10-° mols per liter. Whatever it may be that is 
present in such small concentration, it must be present in much small- 
er concentrations in mice of such strains as show very high rates of 
spontaneous cancer incidence. This may provide a clue for experi- 
mental research. 


The author is indebted to Professor H. D. Landahl for a critical 
reading of this manuscript. 
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STEADY STATES IN RANDOM NETS: I 


ANATOL RAPOPORT AND ALFONSO SHIMBEL 
THE UNIVERSITY OF CHICAGO 


__ A neural net is taken to consist of a semi-infinite chain of neurons 
with connections distributed according to a certain probability frequency 
of the lengths of the axones. If an input of excitation is “fed” into the 
net from an outside source, the statistical properties of the net determine 
a certain steady state output. The general functional relation between 
the input and the output is derived as an integral equation. For a cer- 
tain type of probability distribution of connections, this equation is re- 
ducible to a differential equation. The latter can be solved by elemen- 
tary methods for the output in terms of the input in general and for the 
input in terms of the output in special cases. 


I. The Single Semi-Infinite Chain. 

Consider a number of aggregates of neurons, -4, B,C, ---- such 
that each neuron of aggregate cf sends an axone to a neuron of B, 
effecting a mapping of cf upon B. Similarly, aggregate B is mapped 
on C, etc. Such connections we shall call mapping connections. We 
may also have, in addition to the mappings -4 > B—(C---- , recipro- 
cal mappings, ----C ~B> 4. 

Furthermore, suppose that a neuron of each aggregate sends an 
axone to a neuron in its own aggregate, effecting a self-mapping of 
the aggregate, e.g., eA > eA. Such connections we shall call associa- 
tion connections. 

Some initial state of excitation in a net consisting of such aggre- 
gates will then give rise to succeeding states in accordance with the 
statistical properties of the connections. 

To fix ideas, suppose that each aggregate is a two-dimensional 
lamina, and let all the synaptic delays be equal and taken as a unit 
of time. The initial state of excitation, F.(-4), may be thought of 
as a configuration of neurons in e/ firing at the instant f= 0. Be- 
cause of the mapping connections, -4 > B, a certain mapping of 
F,(cA) will be fired in B at £=1. Call this mapping f,(c4, B). If 
a reciprocal mapping, B —> c/ exists, then a mapping of the configura- 
tion firing in Batt—1, f.(B, 4) will fire in 4 att =2. 

In the meantime, additional events will be happening in -/. Be- 
cause of the association connections in A, there will be a self-map- 
ping of the configuration F'.(¢4) to another configuration f,(e4, 4) 
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firing in 4 att = 1 . At the instant t = 2, therefore, the total con- 
figuration F,(c4) firing in cf will be the logical sum 


fa(cA, A) + fo(B, A). 
And, in general, 


1 
F,(B) =fi(B, B) + files, B), 122. 
Analogous events will occur in a chain of aggregates with re- 
ciprocal mappings 


We might ask whether, under certain assumptions about the sta- 
tistical properties of such nets, steady states can be established. We 
shall seek conditions for such steady states. 

Consider a chain of neurons of semi-infinite length that is equiva- 
lent to the positive part of the real axis. Each neuron will be treated 
as a real point and designated by its coordinate x(x 2 0). The asso- 
ciation connections of the chain will be given by the distribution func- 
tion, K(x, &), that is to say, the probability that a neuron at x re- 
ceives an axone from a neuron lying in the interval (é, 6 + d &) is 
given by K(x, &)d &. Then the probability that a neuron at x re- 
ceives an association axone at all will be given by 


[ Ke, ae. 


In general, we shall suppose that 
| K(z7,é)d&< 1, 
0 


that is, not every neuron receives an association connection. But we 
will suppose that the neurons in our chain can be activated by an 
outside source. Furthermore, the threshold of each neuron will be 
taken to be equal to 1, and no neuron will receive more than one asso- 
ciation connection. This is equivalent to saying that a neuron is sure 
to fire at ¢; if a neuron which sends an association axone to it has 
fired at t;., and that the probability of a neuron at x firing at t; is 
equal to the fraction of neurons in the neighborhood of 2 firing at t; . 

By a firing pattern, f,(«), we shall mean a function of position, 
x , and of the instant, i, which indicates the probability that a neuron 
at x is firing at the instant t=7. 

Suppose now that a firing pattern, $.(x), is applied to our chain 
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ate: 0. What will be the successive firing patterns of our chain? 
They will clearly be given by the following equations. 


fo(a2) = bo(z), 
f(a) = A K(x, &)f.(&) dé, 


fa(2) = [ K@ onde 


= Hi K(x, 2,) [° K(a 8)fol8)d é dan, 
(2) 


f(x) = [ K@,Dfealede 


={ K(e,%3) | ae [~ K(w.,2,) 


f K (a0, EV fo (E) GE dary dity +--+ bits . 


These equations are a special case of equation (2) in the authors’ 
previous paper (Shimbel and Rapoport, 1948). 
Let us now suppose that K(x, &) is given by 


K(x, €) = ke*@®) Bott 


Kx, €) =0 forx<é&. 


In other words, the association connections of the chain go only 
to the right. Such a chain would arise if, when the axones grew, the 
probability of an axone’s acquiring a given length before it was “‘cap- 
tured” by a neuron would be analogous to the probability of a given 
free path length for a gas molecule. 

Under this assumption, the neuron at « = 0 receives no associa- 
tion connection. Any other neuron x may receive a connection from 
some neuron to the left of it, the closest neurons being the most prob- 
able sources. The probability of a neuron at x receiving a connec- 
tion at all is given, in view of equation (3), by 


ic kev) dE=1—-e*, (4) 


(3) 
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This probability increases with « and approaches 1 asymptotically. 


If an initial firing pattern ¢.(x) is now impressed on the chain, 
the successive states will be given by 


fo (x) =, (2), 
fi(e) = iE kere) f,(E)d E= eo i ” eke (EE, 


(5) 


fr(a) =e™ [ het fri(E)d &. 


In particular, if f.(x) = f,, a constant, these equations reduce 
to the following 


fi(z) =f,.l1—e*), 
fo(%) =f, [1—e*(1+ kex)], 


(6) 


; he2.4¢2 kyn-tyen-1 
= — e-ke ep eS 
aR e- | 1+ ker + a lt 

All the distributions are monotone increasing and have a nega- 
tive second derivative with respect to x. All of them approach f, 
asymptotically. The limit of the probability of firing as t > o is 
zero for each neuron, but not uniformly with respect to x. 

Now suppose a firing pattern $(«), constant with respect to time, 
impressed on the net by an outside source. We shall call such a pat- 
tern (impressed at each instant) the input. The equations of succes- 
sive states then become 


fax) =$(#) + [1—4(2)] [K@.) fade. (7) 


The factor [1 — $(«)] denotes the non-additivity of the prob- 
abilities that a neuron is firing because of the outside source or that 
it is firing because of an association connection with a firing neuron. 

A necessary and sufficient condition for a steady state is then 
given by a linear integral equation 
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f(e) =4(2) + [1—4(2)] [ K@. ofede. (8) 


The question whether a given input ¢(x) will actually lead to a 
steady state must be considered separately. If such a steady state is 
actually reached, we shall refer to it as the output. 

Imposing condition (8) on K(x, &) of equation (8), we obtain 


f(x) =$(x) + [1—¢(a)] { ke’) f(E) dé. (9) 


This type of integral equation (with separable kernel) is especially 
simple, since it can be transformed into a linear differential equation 
of the first order. Differentiating both sides of equation (9) with re- 
spect to x, we obtain 


f(a) =$'(a) + F'(x) i ker f(E)AE + kf (x) — ko (a) f(#), (10) 


where F(x) = e*[1 — d(x)] and hence 
F" (x) =e"[ko (x4) —k—¢'(x)]. 
Substituting for 
OL 
its value [f(z) — ¢(x)]/F (a) obtained from equation (9), we obtain 
F’ (x) 
F(x) 
+ kf (x) — kp (x) f(x), 

and, finally, after elementary substitutions and reductions 


f— $f =¢' —f¢' + hp —kg?— kgf + kgf. (12) 


iF (®) = ¢4' (x) [f(x) — $(*)] 


(11) 


This equation can be considered either as a differential equation 
in f with ¢ a known function or a differential equation in ¢ with f a 
Inown function. Taken as the former, it can be written as 


f(1—4) +f (¢' + kp — kg?) =o" + hg — keg? (13) 
lke 


Il 


Theorem 1. The output f = 1 if and only if the input ¢$ (x) 
Proof. Substituting f = 1 into equation (9) we obtain 
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1=4(e) + 1-4@) 1 —e*] 
1=9(2) +1—e*—4(x) + $(a)e* 
e™[¢(x%) —1] =0 
o(x) =1. 
The converse is trivial. 


Theorem 2. The successive states f,(x) are non-decreasing with 
respect to time, that is, f;(x) 2 fi(x) forall x. 


Proof. The conclusion obviously holds for 7 = 1 . We shall make 
an induction on 7. Imposing condition (3) on equation (7) we obtain 


fr(u) =$(") + (1—9(@)] [nee fri(é)d &; (14) 


fai (“%) = o(x) + [1— (2) ] fi kek Ff, (E)CE. (15) 
Subtracting equation (15) from (14), we have 
fn(t) — faa (x) = [1—9(2)] il, ke®€ (f,.(€) —falE)]d €. (16) 


Since ¢(z) is a probability function, 0 = $(#) = 1. Moreover, 
ke®é*) > 0 for all x. Hence, if frni(&) — fr(é) 2 0, 80 is fa(x) — 
fn (%). But this completes the induction. Hence the theorem is 
proved. 


Theorem 3. If ¢(x) and f(x) are taken to be differentiable func- 
tions of x, then the steady state f(x) actually represents an output 
for the given input $(x). 


Proof. Since the steady state is given by a solution of a linear 
differential equation of the first order, it is unique for a given input. 
Moreover, the successive states are non-decreasing and have an up- 
per bound f = 1. Therefore, they approach a limiting function, and 
this cannot be f =1, unless 6 =1. The successive states f; are uni- 
formly continuous in any finite interval; therefore, their limit is con- 
tinuous. Hence, it must be the unique solution of equation (13). 
This proves the theorem. 

If we discard the trivial case ¢ = 1, we may divide both sides of 
equation (13) by (1 — ¢) and obtain 

¢ ¢ 


r+t( ho + ke )aoe + kg. (17) 
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Let us denote ¢’/(1— $) + k¢ by ©. Then the solution of equa- 


tion (17) is 
-[° dr 
f(x) =e | e 


BAe Shussenyytuitest 


Substituting for © its value in terms of ¢, we obtain 


édz = ai dx = rat) 
aye x= (ae ‘) L= log > ae) 
vel pdx , (19) 


3) 


le dr 


Se = 1— $(2) -1f? oar 
— ——————- € ; 


1— $(0) 
and finally 


Tt 
-«f Oo(r)dz 
ty) 


f(x) =1— [1— ¢(@) ]e 
We summarize this result in 


Theorem 4. Let the input be $(x), a differentiable function of x. 
Then the output will be 


«f° o(r)dr 


f(x) =1—[1—¢(2%)]e ; (20) 


Equation (20) gives the output for any input which is a differ- 
entiable function of «. Theorem 3 insures the existence of such an 
output, i.e., that the steady state is actually reached. 

Let us now consider the inverse problem of finding an input 
which will assure a prescribed output. Equation (9) can be solved 
directly for ¢(x) in terms of f(), namely, 


f(a) — { kere f(E)d E 
2 (21) 


o(x) = ; 
1— [komen fayde 
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If f(x) is explicitly given, $(”) can be obtained by quadratures. 
However it may be interesting to consider problems where f is given 
not as a function of x but as a function of ¢. In other words, we 
wish to investigate the input where a certain functional relation is 
given between the output and the input. Certain special cases are 


easily solvable and will be given here. 
In particular, let the output f(z) =f, a constant. Rewriting 
equation (12) as a differential equation in ¢ , we have 


@(1 — f),— he lay be ise i 0n (22) 


Since we have already disposed of the case f = 1 in Theorem 1, 
we can suppose that 1 — f #0. Then we may write equation (22) as 


¢ —k¢? + kp =0; (23) 
d —d d 
ak ee ee 2 (24) 
pe —¢ ? I=¢ 
Integrating equation (24), we obtain 


=— kz, (25) 


lo 
ae 


where C is a constant of integration. Since the neuron at « = 0 fires 
only because of the input, we must have f = ¢(0), Cf =1—f, 
C = (1 — f)/f, and consequently 


(= f)ele) _ oy, 


f[1—$(x)] ~ 
ja = 
DN fee Fae ie 


= another special case, consider the output which is a “mirror 
image” of the input, that is, f(~) = 1 — ¢(x). Then equation (22) 
reduces to 


cf f (x) =CONSTANT 


Figure 1. A dropping input resultin 
; J g in a constant output, the di 
being built up by the i increasing association connections along bean chain. sigh 
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#=—kg(l—9); (27) 
~ oa ies ae 
ips) au: es 


Breaking the left-hand side of (28) into partial fractions, we 
obtain 


doe dd dg¢ 
= — + ——— =~ kde, 
p? p 1—¢ Soe 
and upon integrating 
a | 
log ipepiirans ut" (30) 


To evaluate the constant of integration, A , we note that $(0) = f(0) 
= 1 — ¢(0), hence, ¢(0) = 1/2. Substituting this value into (30) 
we obtain 


2==| to zs +=-2| ol 
i Bats omc: (31) 


This equation is transcendental in ¢ but is solved for x. Its 
graph is shown in Figure 2. 


FIGURE 2. The “mirror image” case. A dropping input associated with a 
symmetrically rising output. 


If any functional relation is imposed on the input and the output 
functions, for example, f = F(¢) where F is a differentiable func- 
tion of ¢, equation (12) can be formally solved by separation of 
variables. In fact, the equation then assumes this form 


ath) +P) OF) —1_ yy, 
é¢[1—F(¢)][1—¢] 


which can be solved by a quadrature if the form of F'(¢) is known. 
However, the only solutions which are significant from the point 
of view of the random net theory are those for which 0 = ¢(x) £1 


(32) 


’ 
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and 0 = f(x) =1 for all x. If a solution of (32) yields either (x) 
or f(x) which violate the inequalities mentioned above, we must con- 
clude that the functional condition f = F(¢) cannot be fulfilled for 
our net. An example of such a situation is the following. 

Suppose we wish our output to be simalar to our input, i.e., to 
satisfy the condition f = C ¢ where C is a constant. By Theorem 1, 
we must have C = 1, and from equation (12) it is evident that C = 1 
if, and only if, f= ¢—0. This case being trivial, we shall suppose 
that C > 1. Then equation (82) reduces to 


__4g(C=) 


o(1—C 4g) (1— 4) 
The formal solution of equation (33) is given by 
i! Ago (18) 
-] ————_——— |= 2. 34 
_log | hea ee 


But we must have forx=—0,f=—=C¢=¢. Since C #1, $(0) 
must be zero. But for ¢ very close to zero, « becomes negatively large, 
and therefore the solution is meaningless. 

One might raise the question concerning the class of functions 
F, such that the condition f = F(¢) may be imposed on the net de- 
scribed here. : 

This work was aided by a grant from the Dr. Wallace C. and 
Clara A. Abbott Memorial Fund of The University of Chicago. 
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Two semi-infinite chains are considered interacting as random nets. 
Conditions for steady state are derived for the cases of cross—excitatory 
and cross—inhibitory association connections. In the eross—inhibitory case 
a@ unique non-trivial self-reproducing steady state is shown to exist. 


As an example of interacting random nets, we shall examine two 
semi-infinite chains of the type treated in Steady States in Random 
Nets: I (Rapoport and Shimbel, 1948), hereafter referred to as I. 

We shall suppose that the chains send association connections 
to each other (for a definition of association connections, see I). A 
neuron in either chain can now fire for any of the following reasons: 


1. It can be excited by an outside source. 


2. It can be excited by an association connection with a firing 
neuron of its own chain. 

3. It can be excited by an association connection with a firing 
neuron of the other chain. 

Let the chains be denoted by ¥ and G and let them be “fed” by 
the respective patterns ¢(”) and y(xz) where these functions denote 
the probability of firing of the neuron at x. The variable z, as in I, 
denotes the distance from the beginning of each of the two semi- 
infinite chains. Then, if K(x, &) denotes the probability of connec- 
tion of the neuron at x to a neuron at & of either chain, the equations 
for the resulting firing patterns, f,(”) and g,(x) will be given by 


faz) =1— (1 —a(e)]| 1— [x@.5e.45 || 1 


— (Kz, 8)fralSaé 
J K(@,é)Iaals a 


g.(2) =1—[1—yt@)1| 1— [ Ke, dfatode || 1 


= [xe does | ! 
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Each factor in brackets expresses the probability that the neuron at 
x does not fire because of either the outside source or one of the asso- 
ciation connections. Hence the product of these factors subtracted 
from unity gives the probability that the neuron at 2 does fire at 
t=n. 

For steady states in J and G, equations (1) reduce to a system 
of non-linear integral equations 


f(z) =1-T1-g@1[ 1— [ K@.H0@a¢ || 1 
= [xe niece] 
g(2) =1—[1—7(e)1| 1— [ x@.or@de]| a 


ee [xe po@ae]. 


In this paper we shall treat only the symmetric case where 
$(x%) = y(x) and hence f(x) = g(x). We shall denote 


{ K(x, &)f(&)dé 
by F(x) and will take our kernel to be separable as in I, so that 
F(a) = fee f(e)dé. (3) 
0 
Note that F(x) satisfies the differential equation 
F' (2) =k[f (2) —F(a)]. (4) 
For the symmetric case, equations (2) reduce to 
i) a fa eye (5) 
Differentiating both sides of (5), we obtain 
f= 2(t-— *) l= eho etre )2. (6) 
Furthermore, solving equation (5) for F, we get 
ig: 
F=1—,./—. 
me (7) 


Substituting the value of F from (7) into (4), we get 
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I-F 
hos ———— — 
oleae (1 n|. (8) 


Finally, substituting (8) and (7) into (6), we derive the following 
differential equation for f 


2 eet td a: 1— 
f =2ky (1—f) A—¢) cs Cli 7) it ae (9) 
A est tL? 
Denoting 1 — f by f and 1 — ¢ by ¢, we obtain equation (9) in a 
simpler form, namely, 
f + f(2k— $'/$) = 2kfs/? ov. (10) 
This differential equation is non-linear in 7, but is easily solvable by 
the substitution z = (f)-*. This change of variable reduces equa- 
tion (10) to 
2’ —2z(k— $'/26) =— k 9”, (11) 


which is linear in z and has for solution 
r= Go| —k { ee F(xyde + |. (12) 
0 
Since the neuron at x = 0 has no association connections, we must 
have f(0) = ¢(0). Hence z2(0) = [¢(0)]-”. Therefore 


C= [$(0)/$(0)]”. 
Resubstituting (1 — f)-” for z, we obtain finally as the solution 
of equation (9) 


1— $¢(x) 
ee eo oes es (13) 
em | ( 3(0) ) kf e- (1 gle) )de | 


We shall next consider a “cross-inhibitory” case. Let now the 
association connections of J on G and of G on F be of inhibitory kind, 
that is, if a neuron at x receives a stimulus at t = n from a neuron 
of the other chain, it will not fire no matter what other stimuli it re- 
ceives. The steady state equation in this case will be 


fe ear( To) (I(r). (14) 
The equation states that a neuron at x fires if it receives a stimulus 


from either the outside source (probability ¢) or from an association 
connection from its own chain (probability Ff’), provided it does not 
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at the same time receive a stimulus from an association connection 


from the other chain (probability (1 — F)). 
Differentiating both sides of equation (14), we obtain 


f=—F'+¢(1—F)?+2(1—¢)1—F)F, (15) 
which, upon substituting of the value of F’ from (4), becomes 
f=kF—kf+¢A—F)?+2k(f—F)1—¢)A—F). (16) 
However, equation (14) solved for F yields 
1+ V1—4f + 4. 
peer i (17) 
2(1—#) 
These values substituted into (16) reduce the latter to two differ- 
ential equations which determine f as a function of ¢. The equations 
are non-linear in f and in ¢, and no attempt will be made here to 
solve them or to obtain any information as to the significance of the 
ambiguity of equation (17). We shall only investigate the special 
case where f = ¢. That is to say, we seek an input function ¢(2) 
such that in the steady state the output function f(a) shall be equal 
to it. 
This situation was not considered in any of the cases treated in 
I, nor in the cross-excitatory case of the present paper, because it is 
evident that without inhibitory connections, the only self-reproduc- 
ing steady states are the trival ones, 6 = 0 and¢d—1. 
Assuming f = ¢ reduces equation (17) to 


Ler Gaa2e) 
Y ies a rere oe) 18 
2(1—@) rt 
or to 
1— (1—2 1— 2. 


2(1— 4) i> ¢ 


Discarding the trivial case (18), which is equivalent to assum- 
ing that there are no association connections at all, we proceed to de- 
rive our equation of the steady state on the basis of (19). 

Equation (16) reduces to 


(1 — 29) d¢ 
(1— $) (¢?—3¢ + 1) 


From equation (20) it is immediately evident that the constant 
input ¢ = 1/2 satisfies the differential equation of the steady state. 


=k(1—24) da. (20) 
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It also satisfies the boundary condition, since. by: definition of F(x), 
we must have F(0) = 0, which substituted into equation (19) gives 
¢(0) = 1/2. It remains to investigate whether the constant input 
¢ = 1/2 is the only self-reproducing input under the conditions of 
cross-inhibitory association connections considered here. 


Discarding the solution ¢ = 1/2, we obtain from (20), the dif- 
ferential equation 


Bee SP ans in 
(1—$) (g?—3¢6 + 1) 


which, upon integration by the method of partial fractions, yields the 
general solution 


log (1 — ¢) — 1/2 log (11 — $) —1/2 log (¢ — 72) 


1 
lac (7,— 6) — 


2/5 


where 7, = 3/2 + V5/2, re = 3/2 — \/5/2, and A is a constant of 
integration. Equation (21) may be rewritten as. 


1 = 
log ee ee = kez. (22) 
v5-1 V54+1 


(ri) eek (bee 


=kdz, 


(21) 
-- 


log (¢—1r2) + log A=kz, 


The boundary condition ¢(0) = 1/2 fixes the constant A. The 
curve starts at ¢(0) = 1/2 and is monotone decreasing, approaching 
the line ¢ =r. ~ 0.39 asymptotically as shown in Figure 1. 


FIGURE 1. The non-constant self-reproducing input given by equation (22). 


226 . RANDOM NETS 


This work was aided by a grant from the Dr. Wallace C. and 
Clara A. Abbott Memorial Fund of The University of Chicago. 


LITERATURE 


Rapoport, A. 1948. “Cycle Distributions in Random Nets.” Bull. Math, Bio- 
physics, 10, 145-157. 

Rapoport, A. and Shimbel, A. 1948. “Steady States in Random Nets: I.” Bull. 
Math. Biophysics, 10, 211. 

Shimbel, A. and Rapoport, A. 1948. “A Statistical Approach to the Theory of 
the Central Nervous System.” Bull. Math. Biophysics, 10, 41-55. 

Shimbel, A. 1948. “An Analysis of Theoretical Systems of Differentiating Ner- 
vous Tissue.” Bull. Math. Biophysics, 10, 181-148. 


BULLETIN OF 
MATHEMATICAL BIOPHYSICS 
VOLUME 10, 1948 


BOOK REVIEW 


JOHN H. NorTHRop, Moses KUNITZ AND ROGER M. HERRIOTT. Crystalline Enzymes. 


ae edition, 1948. xxi + 352 pp. New York: Columbia University Press. 
7.50. 


This new edition of Crystalline Enzymes, which has been extensively revised 
and enlarged, follows its predecessor after nine years. The First Edition was based 
upon the Jesup Lectures given in the spring of 1938 at which time ten enzymes 
had been crystallized and identified as proteins. A list of thirty-nine crystalline 
enzymes is presented in the new edition. 

At present, the identity of the crystalline protein and the enzyme seems to 
be an inescapable fact and is seldom questioned; for those who still have doubts, 
cogent arguments (whether or not explicit) are to be found in practically every 
chapter of this book. New material has been included in all chapters. Added 
topics include chapters on two “new” enzymes (ribonuclease and hexokinase), a 
chapter on crystalline diphtheria antitoxin, and (appropriately in view of the 
work carried out during the war and still being actively pursued) a chapter deal- 
ing with the reaction of mustard gas with proteins and enzymes. 

The subject matter of this book, as in the case of the First Edition, is ex- 
pressly restricted to results of research done at Rockefeller Institute and subjects 
closely related to these results; consequently, the enzymes discussed are, with the 
exception of ribonuclease and hexokinase, proteolytic enzymes. Included also are 
the precursors and inhibitors of the various enzymes, bacteriophage, and diph- 
theria antitoxin. 

Rather than impair the continuity of the text with a statement of detailed 
procedure, the authors discuss the stepwise procedure for isolation, fractionation, 
and crystallization of the enzymes in an extensive Appendix. The book is ex- 
cellently documented with graphs and figures and no less than 500 references 
which are given in a separate bibliography. 

While manifestly this book will be of greatest interest to those whose business 
it is to isolate and study enzymes, it describes methods and techniques which now 
concern more workers than might at first be thought. The original crystallization 
of an enzyme, in general, presents formidable technical difficulties and is a task 
from which one might shrink with no sense of false modesty. The availability of 
reproducible methods for obtaining highly purified or crystalline enzymes, how- 
ever, has led to their widespread use. Today it is not unusual for an investigator 
to have on hand an array of such preparations to be used as test systems in- 
cidental to his major problem. The use of highly purified enzymes for the analyti- 
cal determination of various metabolites has rapidly increased in recent years. 

Crystalline Enzymes contains much material which is of quite general in- 
terest; for example, the discussion of the equilibrium between native and de- 
natured protein and the thermal analysis of this equilibrium. This concept of a 
reversible shift from native protein to denatured protein has made its appear- 
ance explicitly in the more recent formulations of enzymatic rate processes in 
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their dependence upon temperature and is repeatedly invoked in discussions of 
temperature effects on living cells. 

Other features of rather general interest and use include an excellent ac- 
count (given in the Appendix) of the porous diaphram method for the determi- 
nation of diffusion coefficients. A discussion is given of relevant information, other 
than molecular weight and diffusion coefficient, which may be obtained from dif- 
fusion studies; the necessary equations are derived and the methodology is given 
in some detail. Another valuable discussion deals with the application of Gibb’s 
phase rule to protein solutions. Results of such studies are given throughout the 
text and the Appendix contains a discussion of the theory involved and experi- 
mental methods employed. The phase rule is the essence of simplicity as is, in 
principle, its application to physicochemical systems. In the study of protein 
solutions, however, there are several factors to be considered and matters are 
not always simple. One usually has to deal with systems of four or more com- 
ponents, viz., water, salt, acid, and protein. While it is true that an additional 
component, whose concentration is fixed, introduces no change in the number of 
degrees of freedom, it is necessary, in practice, to examine the question of the 
extent to which the conditions of constant acidity and salt concentration may be 
met when the amount of’ solid protein is varied. Just such considerations are dis- 
cussed in a lucid manner. Also the various cases which arise (mixture of proteins, 
solid solution, etc.) are brought together and discussed in a valuable presentation. 

Most interesting is the final chapter of the book wherein a general discussion 
of protein synthesis is presented. The general theme developed is that the for- 
mation of viruses, the elaboration of enzymes, and the formation of “normal 
proteins” are but aspects of the general problem of protein synthesis. The possible 
mechanisms of synthesis are placed in two classes: shift of equilibrium by change 
in concentration, or removal of product and coupled reactions. In the discussion 
of the various aspects of these types of reactions two points, which heretofore 
have received but scant attention, are stressed: the formation of native protein 
in contradistinction to denatured protein and the possibility of accounting to 
some extent for the specificity of synthesis on the basis of the chemical properties 
of the protein itself. Both points warrant some comment. 


It is stated that most native proteins are very slowly hydrolyzed and that 
the possibility is, therefore, open that the first step in the hydrolysis of native 
protein is the denaturation of the protein. Evidence is also cited to indicate that 
globular proteins are not hydrolyzed by trypsin unless they are in the denatured 
form but that fibrous proteins are hydrolyzed at about the same rate in the 
native and denatured forms. The proposition is then forwarded that, “If enzy- 
matic hydrolysis does require preliminary denaturation, then it could be assumed 
that native proteins can be synthesized without adding energy, i.e., by a purely 
catalytic reaction. Energy is required to denature the protein which then hy- 
drolyzes with the liberation of energy.” It must be granted that the experimental 
fact that the equilibrium protein = amino acids is far to the right is established 
only for the case of denatured protein; this is a fact not previously invoked in 
the discussion of the energetics of protein synthesis and deserves some attention. 
It also seems clear, however, that the A F’,’s of the syntheses of native and de- 
natured proteins can differ only by the A F, of the denaturation. In cases where 
the data is available, the A F, of denaturation is rather small and could not be 
an important factor in these cases. 


The interesting suggestion is made that protein synthesis may be specific in 
the sense that ordinary chemical reactions are specific, viz., only one or a small 
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number of the possible reaction products actually appears. The example given is 
that of the formation of NaCl and H,O from NaOH and HCl. Statistically a great 
number of products are possible, but only NaCl and H,O are stable under the 
usual conditions. This point of view is similar to that adopted in the statistical 
mechanical treatment of chemical equilibria: that part of phase space which is 
reached but slowly is regarded as non-existent. Here, however, the system is con- 
sidered to be “inhibited” on a rate basis. Obviously a system is never in equili- 
brium with respect to every possible reaction; only those states rapidly attained 
are considered. Whatever the control of specificity in protein syntheses may be, 
it is exceedingly stringent and would seem to require some special device. For 
example, if a protein is considered to consist of 288 amino acids equally dis- 
tributed among twelve different amino acids, then if one molecule of every pos- 
sible isomer existed, the total mass would exceed the mass of the earth by a 
factor of 10253, This calculation, due to Schlenk, does not include configurational 
isomerism but clearly shows, even with this restriction, the physical impossibility 
of the existence of a single molecule of each isomer. 

The authors finally suggest a working hypothesis for protein synthesis. 
Briefly, they consider that the first stage is the formation of one or more “type” 
precursor or “proteinogen” which exhibits organ and species specificity. The 
proteinogen is considered to be similar to the ur-protein suggested by Alcock in 
1986; its formation requires energy and is autocatalytic. The second step is the 
(spontaneous) formation of the individual proteins from the proteinogens. On 
the basis of this hypothesis, the authors discuss the formation of normal protein, 
adaptive enzymes, antibodies, and viruses. 

Although the hypothesis and its basis are not wholly acceptable to this re- 
viewer, they embody features which are logically attractive and of great in- 
terest; the spirit in which this hypothesis is forwarded will be appreciated by 
the readers of this journal. 

JOHN Z. HEARON 
The University of Chicago 
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